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when a manipulation request for the shared data is generated, an event indicating that manipulation request is output onto the network. 

^ An event as a reply to the event output onto the network is received from the network. A manipulation for the shared data is executed 
in accordance with the received event. In this way, the manipulation execution timings for shared data to be shared by a plurality of 
processes can be accurately matched. 
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DESCRIPTION 
INFORMATION PROCESSING METHOD AND APPARATUS 



TECHNICAL FIELD 
5 The present Invention relates to a technique for 

sharing data among a plurality of processes and, more 
particularly, to a technique suited to synchronize 
databases, which hold data that describe a 
three-dimensional virtual space, among a plurality of 
10 processes via a network. 

BACKGROUND ART 

A technique for sharing a three-dimensional (3D) 
virtual space among different computer terminals is 

15 indispensable to implement remote meeting systems, 

network games, cooperative design systems, and the like. 

Such system that shares a 3D virtual space refers 
to a large volume of data at short time intervals so as 
to draw moving images on the virtual space by computer 

20 graphics. At this time, it is not practical to acquire 
whole virtual space data held in one apparatus (e.g., 
server) via a network due to the narrow bandwidth of 
the current network. Therefore, in a method which is 
currently adopted, respective terminals have copies of 

25 the virtual space data and generate CG images by 
referring to them. When an arbitrary manipulation 
(e.g., movement or rotation of a virtual object) has 
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been made for the virtual space on a given computer 
terminal, information associated with that manipulation 
is transmitted to other terminals via the network, thus 
reflecting that information on the databases of the 
5 respective terminals. As a result, the consistency 
among the databases of the respective computer 
terminals is maintained. 

Details of the sequence for holding the 
consistency among the databases in the conventional 

10 virtual space sharing system will be described below. 
That is, a manipulation for the virtual space at a 
given computer terminal is immediately reflected on the 
local database of that terminal, and the manipulation 
information is transmitted to other computer terminals. 

15 Other terminals receive this manipulation information, 
and update their data according to the received 
manipulation information. 

As an implementation example of such virtual 
space sharing system. Distributed Open Inventor 

20 (source: G. Heshina et. al. : "Distributed Open 

Inventor: A practical Approach to Distributed 3D 
Graphics", in Proc. of the ACM Symposium on Virtual 
Reality Software and Technology (VRST'99), pp. 74-81, 
1999) is known. 

25 However, in the conventional virtual space 

sharing system, the contents of a given manipulation 
are immediately reflected on a database of a terminal 
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at which that manipulation has been made, and other 
terminals update their databases after they receive 
that manipulation information. Therefore, the terminal 
at which the manipulation has been made and other 
5 terminals update their databases at different timings. 
Especially, if it takes long until reception of 
manipulation information due to the Influence of 
network traffic or the like, the update timing 
differences of the databases among the terminals become 

10 large. For this reason, it is more likely that the 
terminals generate different drawing results of the 
virtual space. 

The manipulation and update sequences of the 
databases are fixed to those described above, and the 

15 data update timing cannot be selected or adjusted. 

Therefore, a system which allows a plurality of 
processes to nearly concurrently execute a manipulation 
for shared data, which is shared by these processes, is 
demanded. 

20 

DISCLOSURE OP INVENTION 
According to one aspect of the present invention, 
there is provided an information processing method for 
maintaining, in a system in which each of a plurality 
25 of processes connected via an information transmission 
medium holds and uses shared data to be shared by the 
processes, consistency of shared data held by the 
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respective processes, comprising: an output step of 
outputting, when a manipulation request for the shared 
data is generated, request information that represents 
the manipulation request onto the information 
5 transmission medium; a reception step of receiving the 
request information output in the output step and 
response information corresponding to request 
information output by other processes from the 
information transmission medium; and a manipulation 

10 execution step of executing a manipulation for the 
shared data in accordance with manipulation request 
indicated by the response information received in the 
reception step. 

Furthermore, according to another aspect of the 

15 present invention, there is provided an information 
processing apparatus for maintaining, in a system in 
which each of a plurality of processes connected via an 
information transmission medium holds and uses shared 
data to be shared by the processes, consistency of 

20 shared data held by the respective processes, 

comprising: an output unit configured to, when a 
manipulation request for the shared data is generated, 
output request information that represents the 
manipulation request onto the information transmission 

25 medium; a reception unit configured to receive the 
request information output by the output unit and 
response information corresponding to request 
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information output by other processes from the 
information transmission medium; and a manipulation 
execution unit configured to execute a manipulation for 
the shared data in accordance with manipulation request 
5 indicated by the response information received in the 
reception unit . 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
10 drawings , in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF DRAWINGS 
15 The accompanying drawings, which are incorporated 

in and constitute a part of the specification, 

illustrate embodiments of the invention and, together 

with the description, serve to explain the principles 

of the invention, 
20 Fig. 1 is a block diagram showing the overall 

arrangement of a database sharing system according to 

the first embodiment; 

Fig. 2 shows a basic information transmission 

method among processes according to the first 
25 embodiment; 
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Fig. 3 is a block diagram showing the hardware 
arrangement of a terminal device according to the first 
embodiment; 

Fig. 4 is a chart showing the database update 
5 sequence in a wait mode; 

Fig. 5 is a chart showing the database update 
sequence in an immediate mode; 

Fig. 6 is a chart showing the database update 
sequence in a delay mode (when a time-out is not 
10 generated) ; 

Fig. 7 is a chart showing the database update 
sequence in a delay mode (when a time-out is 
generated) ; 

Fig. 8 shows an example of the data configuration 
15 of event data; 

Fig. 9 shows an example of the data configuration 
of a manipulation queue; 

Fig. 10 shows an example of the data 
configuration of a manipulation queue item; 
20 Fig. 11 is a flow chart showing a client process 

according to the first embodiment; 

Fig. 12 is a flow chart showing a manipulation 
process in the client process; 

Fig. 13 is a flow chart for explaining a wait 
25 mode manipulation process in Fig. 12; 

Fig. 14 is a flow chart for explaining an 
immediate mode manipulation process in Fig. 12; 
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Fig. 15 is a flow chart for explaining a delay 
mode manipulation process in Fig. 12; 

Fig. 16 is a flow chart showing a received event 
process in the client process shown in Fig. 11; 
5 Fig. 17 is a flow chart of an immediate mode 

received event process in Fig. 16; 

Fig. 18 is a flow chart of a delay mode received 
event process in Fig. 16; 

Fig. 19 is a flow chart for explaining a timer 
10 process; 

Fig. 20 is a flow chart for explaining a server 
process according to the first embodiment; 

Fig. 21 is a flow chart for explaining an event 
distribution process of a server according to the 
15 second embodiment; 

Fig. 22 shows an example of the data 
configuration of event data according to the third 
embodiment ; 

Fig. 23 is a flow chart for explaining an event 
20 distribution process of a server according to the third 
embodiment; 

Fig. 24 shows the description file format of a 
database; 

Fig. 25 shows an example of a client display 
25 window in the fifth embodiment; 

Fig. 26 shows an example of a client display 
window in the fifth embodiment; 
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Fig. 27 is a perspective view showing the outer 
appearance and arrangement of a stylus device in the 
fifth embodiment; 

Pig. 28 shows an example of a client display 
5 window in the fifth embodiment; 

Fig. 29 is a flow chart for explaining a 
manipulation process in the fifth embodiment; and 

Fig. 30 is a schematic diagram showing the method 
of setting a time-out time in the eighth embodiment. 

10 

BEST MODE FOR CARRYING OUT THE INVENTION 
Preferred embodiments of the present invention 
will now be described in detail in accordance with the 
accompanying drawings. 
15 [First Embodiment] 

The first embodiment will explain an 
implementation example in which an information 
processing method according to the present invention is 
applied to a virtual space sharing system that allows a 
20 plurality of terminals to share scene databases which 
describe the structure and properties of a virtual 
space . 

Fig. 1 shows the overall arrangement of the 
virtual space sharing system of this embodiment. The 
25 system includes one server process 101 (to be simply 

referred to as a "server" hereinafter), and a plurality 
of client processes 103 ((to be simply referred to as 
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"clients" hereinafter ) , which exchange data via a 
network 102. Each client holds a scene database which 
describes the structure and properties of a common 
virtual space. Note that the network 102 of this 
5 embodiment is a LAN built on the Ethernet. 

A term "database manipulation" used in the 
following description will be explained. A 
"manipulation" of a database indicates a procedure for 
rewriting the contents of a database in an arbitrary 

10 process having a shared database. The database 

manipulation is classified into two procedures, i.e., 
"manipulation command" and "manipulation execution". 
The manipulation command is an update request of the 
database, and does not actually rewrite the contents. 

15 The actual rewrite process of the database is executed 
in the manipulation execution process. Hence, 
"manipulation" will indicate "database manipulation" 
herein unless otherwise specified. If an object to be 
manipulated is other than a database, the object to be 

20 manipulated is specified like "interactive device 
manipulation by the user" . 

Note that the manipulation command may be 
generated by the user or by a process during an 
operation. As the former example, the manipulation 

25 command is generated when the user has moved a virtual 
object by manipulating an interactive device such as a 
mouse or the like. On the other hand, as the latter 
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example, the manipulation command is generated when, 
e.g., a game program has algorithmically moved/rotated 
an enemy character in a shooting game system. 

Pig. 2 shows the basic information flow upon 
5 updating databases. In Fig. 2, reference symbols A, B, 
C, and D (201 to 204) denote clients; and X (205), a 
server. Assume that client A (201) has generated a 
manipulation command of a scene database. The contents 
of the manipulation command are transmitted to the 

10 server via a network (a process indicated by arrow (1) 
in Fig. 2). Upon reception of this manipulation 
command, the server distributes data transmitted from 
client A (201) to all clients (a process indicated by 
arrow (2) in Fig. 2). Through these processes, 

15 non-manipulator clients B (202), C (203), and D (204) 
can also detect the manipulation contents . 

Hereafter, data which represents the manipulation 
contents is occasionally inscribed with "event". 

Fig. 3 shows the arrangement of a terminal on 

20 which the client or server process runs. Referring to 
Fig. 3, reference numeral 301 denotes a CPU which 
controls the operation of the overall terminal. 
Reference numeral 302 denotes a memory which stores 
programs and data used in operations of the CPU 301. 

25 Reference numeral 303 denotes a bus which transfers 
data among respective building modules. Reference 
numeral 304 denotes an interface between the bus 303 
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and respective devices. Reference numeral 305 denotes 
a communication module which is used to send data to or 
to receive data from the network; 306 , an external 
storage device which stores programs and data to be 
5 loaded by the CPU 301; 307 and 308, a keyboard and 
mouse, which form an input device used to designate 
operations of programs; 309 , a display module which 
displays the operation result of the process; and 310, 
an input /output module with devices outside the 

10 terminal. For example, a stylus device shown in 
Fig. 27 is connected. 

The system of this embodiment has the following 
three modes in association with the update timings of a 
database. These modes will be generically named as 

15 "update mode" hereinafter. 

(1) Wait mode 

(2) Immediate mode 

(3) Delay mode 

The respective modes will be described in detail 

20 below. 

In "wait mode", manipulation execution of a given 
manipulation command is made after waiting for 
distribution of an event from the server. Fig. 4 
illustrates the processing sequence along with an 
25 elapse of time in the wait mode. In Fig. 4, 

"manipulator" indicates a client that has generated the 
manipulation command, and "non -manipulator" Indicates a 
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client other than the manipulator. The procedures 
progress as follows. 

In procedure T401, the manipulator client issues 
a manipulation command of a database. At this time, 
5 the database of the manipulator client is not updated. 
An event that indicates the manipulation contents in 
procedure T401 is generated in procedure T402, and is 
transmitted to the server in procedure T403. The 
server receives that event in procedure T404, and 

10 transmits the event to all clients which have 

established connection to the server in procedure T405 
(establishment of connection will be explained later in 
step S1102 in Fig. 11). The manipulator client 
receives the event issued by the server in procedure 

15 T406, analyzes the contents of the event (T407), and 
rewrites the database (T408). The same procedures 
after reception of the event apply to each 
non-manipulator client (procedures T409 to T411). As 
shown in Fig. 4 r in the wait mode a time lag is 

20 generated from the manipulation command (T401) until 
the manipulation execution (T408). However, if 
information is transferred on the network under the 
same condition, it is expected that both manipulator 
and non-manipulator clients update their databases at 

25 nearly the same time, and images on the virtual space 
are synchronized among the clients. 
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In "immediate mode 11 , a manipulator's command is 
immediately reflected on the database, and a 
non -manipulator's database is updated behind that 
update timing. Fig. 5 illustrates the processing 
5 sequence along with an elapse of time in the immediate 
mode. The procedures progress as follows. 

In procedure T501, the manipulator client issues 
a database manipulation command. In procedure T502, 
the database is updated in accordance with the contents 

10 of the manipulation command. After that, an event 
indicating the manipulation contents is generated 
(T503), and is transmitted to the server (T504) . After 
event transmission, the manipulator client holds 
information indicating the manipulation command in 

15 procedure T501 and its execution in a manipulation 
queue (T505; "manipulation queue" will be described 
later) . 

The server receives the event in procedure T506, 
and transmits that event to all clients in procedure 

20 T507. Upon reception of the event from the server in 
procedure T508, the manipulator client refers to the 
manipulation queue (T509). Since the manipulator 
client recognizes based on the information recorded in 
procedure T505 that the manipulation has already been 

25 executed, it skips the manipulation execution process, 
and deletes the information recorded in procedure T505 
(T514). 



•c 1 
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On the other hand, each non-manipulator client 
recognizes with reference to its manipulation queue 
that the event received in procedure T510 has not been 
executed yet (T511), and executes the manipulation on 
5 the basis of the event contents (T512, T513). 

When the databases are updated in the 
aforementioned sequence, the time delay produced until 
the manipulator client reflects the manipulation result 
for the virtual space on a CG image can be shorter than 

10 in the wait mode. Therefore, the immediate mode is 

mainly suitable for a case wherein the user manipulates 
a virtual object using an interactive device. This is 
because if any time difference is generated between the 
user's interactive manipulation and presentation of its 

15 result, problems (e.g., making manipulations harder, 
making the user uncomfortable, and so forth) are 
normally posed. 

In the "delay mode", the manipulation command is 
not immediately executed unlike in the wait mode, but a 

20 manipulation execution time limit is set, and the 

manipulation is executed without waiting for an event 
sent back from the server if the manipulation execution 
time limit has been reached. Fig. 6 illustrates the 
processing sequence along with an elapse of time when 

25 an event comes from the server before the manipulation 
execution time limit is reached in the delay mode. The 
procedures progress as follows. 
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In procedure T601, the manipulator client issues 
a database manipulation command. At this time, the 
database is not updated. An event indicating the 
contents of the manipulation in procedure T601 is 
5 generated in procedure T602, and is transmitted to the 
server in procedure T603. After event transmission, 
the manipulator client holds information indicating the 
manipulation command in procedure T601 in a 
manipulation queue (T604; "manipulation queue" will be 

10 described later), and launches a timer process (T605) . 
The timer process executes the manipulation if a 
time-out is generated, and details thereof will be 
described later using Fig. 19. 

The server receives the event in procedure T606, 

15 and transmits the event to all clients in procedure 
T607. The manipulator client receives the event in 
procedure T608 and refers to the manipulation queue 
(T609). Since the manipulator client recognizes that 
the manipulation has not been executed yet, it records 

20 information indicating that the manipulation has 

already been executed in the manipulation queue (T610), 
analyzes the contents of the event (T611), and rewrites 
the database (T612). Furthermore, the manipulator 
client deletes information recorded in procedure T604 

25 (T617). Also, each non-manipulator client recognizes 
that the event received in procedure T613 has not been 
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executed yet (T614), and executes the manipulation 
based on the event contents (T615, T616). 

On the other hand. Pig. 7 illustrates the 
processing sequence along with an elapse of time when 
5 the manipulation execution time limit (time-out) is 
reached before an event comes from the server in the 
delay mode. The procedures progress as follows. 

In procedure T701, the manipulator client Issues 
a database manipulation command. At this time, the 

10 database is not updated. An event indicating the 
contents of the manipulation in procedure T701 is 
generated in procedure T702, and is transmitted to the 
server in procedure T703. After event transmission, 
the manipulator client holds information indicating the 

15 manipulation command in procedure T701 in a 

manipulation queue (T704; "manipulation queue" will be 
described later), and launches a timer process (T705). 
The timer process executes the manipulation if a 
time-out is generated, and details thereof will be 

20 described later using Fig. 19. The server receives the 
event in procedure T706, and transmits the event to all 
clients in procedure T709. 

If the time-out time is reached before a 
corresponding event is received from the server, it is 

25 detected in the timer process, and the manipulator 

client executes the manipulation in procedure T707 and 
stores information indicating that the manipulation has 
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already been executed in the manipulation queue (T708). 
Therefore, although the manipulator client receives the 
event in procedure T710, it recognizes with reference 
to the manipulation queue that the manipulation has 
5 already been executed (T711), and updates a 

manipulation history (T712 (deletes a manipulation 
queue item corresponding to the event which has already 
been executed and has already been distributed from the 
server process)). Each non-manipulator client 

10 recognizes that the event received in procedure T713 
has not been executed yet (T714), and executes the 
manipulation based on the event contents (T715, T716). 

When the databases are updated in the 
aforementioned sequence, if a time lag upon event 

15 distribution is large, operations are made to minimize 
the delay time before the manipulation execution; if a 
time lag is small, operations are made to synchronize 
clients. Such operations are automatically switched, 
and which of operations are dominant can be adjusted by 

20 appropriately setting the time-out time. 

Pig. 8 shows the contents of an event issued from 
the client to the server, or from the server to the 
client. Event data is made up of a plurality of fields. 
A client ID field 801 stores a number which is used to 

25 uniquely identify each client and is assigned by the 
server when the client establishes network connection 
to the server (to be described later in step S1102 in 
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Fig. 11). A manipulation ID field 802 stores a number 
which is used to uniquely identify a manipulation, and 
is assigned when a manipulation command is issued at 
each client. Using the pair of client and manipulation 
5 IDs, all manipulation commands that have been issued in 
the system can be uniquely specified. 

An update mode ID field 803 stores an 
identification number which is uniquely determined for 
each update mode, and is determined by an update mode 

10 of a manipulation command corresponding to this event. 
Since the update modes are set and registered in each 
entry of the database (to be described later using 
Fig. 24), the update mode is set with reference to that 
entry. An entry ID field 804 stores a number which is 

15 used to uniquely identify each entry of the database, 
and is assigned upon loading data from a file. A 
manipulation content field 805 stores the detailed 
contents of a manipulation command. For example, when 
a manipulation for setting the X-coordinate of a CG 

20 object to a given value is made, this field stores a 
set of a number that identifies an X-coordinate 
property, and an X-coordinate setting value. 

The manipulation queue will be described below. 
The manipulation queue is a list of manipulation 

25 commands which wait for reception of events or 

execution processes. If there are m manipulation 
commands in the waiting state at an arbitrary time, the 
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manipulation queue Is formed by listing up m pieces of 
information (queue items) associated with manipulation 
commands in the order the commands are generated, as 
shown in Fig. 9. 



three data fields , as shown in Fig. 10. A manipulation 
ID field 1001 stores a number which is used to uniquely 
identify a manipulation, and has the same value as that 
of the manipulation ID field of the corresponding event. 

10 The value of the manipulation ID field 1001 is assigned 
when a manipulation command is issued at each client. 
A time-out time field 1002 stores a manipulation 
execution time limit in the delay mode, and this time 
limit is calculated by adding a predetermined time-out 

15 time to the current time when a manipulation command is 
issued at each client. An already executed flag field 
1003 indicates if a manipulation having that 
manipulation ID has already been executed in the 
immediate or delay mode. The already executed flag is 

20 set to OFF when a manipulation command is issued, and 
is changed to ON when the manipulation is executed. 

Note that Fig. 10 shows the manipulation queue 
item having three fields. Alternatively, the already 
executed flag and time-out time may be combined. In 

25 this case, when the time-out time assumes a special 

value (e.g., -1), such case may be defined to indicate 
that the manipulation has already been executed. 



5 



The contents of one queue item are formed of 
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The processing flows of the client and server 
will be described in detail below. 

Fig- 11 shows the overall flow of the client 
process. When the client is started up, it loads a 
5 file that describes the virtual space from the external 
storage device 306 (Fig. 3) in step S1101 to build a 
scene graph database on the memory 302 (Fig. 3). In 
order to maintain data consistency among clients, the 
files to be loaded have the same contents among clients . 

10 The client establishes network connection to the server 
(step S1102). At this time, the server assigns a 
client ID which is used to identify each client. Note 
that data exchange between the client and server is 
attained by a one-to-one socket communication using the 

15 TCP/IP protocol. Therefore, the server has socket 

communication paths as many as at least the number of 
clients . 

In step S1103, the procedure forks to launch a 
manipulation process (step S1104) for processing a 

20 manipulation command, and a received event process 

(step S1106) for processing an event received from the 
server. Note that a process for generating a CG image 
of the virtual space with reference to the scene graph 
database is also launched (not shown in Fig. 11). 

25 Since this process is the same as the known CG image 

generation method, a detailed description thereof will 
be omitted. The manipulation process and received 



WO 2004/051480 W 

T/JP2003/015274 

- 21 - 



event process will be described in detail later. In 
each of the manipulation process and received event 
process, it is checked in step S1105 or S1107 if a 
process end instruction is detected. If NO in step 
5 S1105 or S1107, the flow returns to step S1104 or S1106 
to continuously process the manipulation command or 
received event. On the other hand, if YES in step 
S1105 or S1107, the processes are joined in step S1108. 
After network connection to the server is disconnected 

10 (step S1109), the contents of the database are saved as 
a file in the external storage device (306 in Fig. 3) 
(step S1110), thus ending all processes. 

The manipulation process in step S1104 will be 
described in detail below with reference to Fig. 12. 

15 Initially, the contents of a manipulation command are 
input in step S1201. At this time, a manipulation ID 
number that uniquely specifies the manipulation command 
is determined. In steps S1202 and S1203, an update 
mode is determined with reference to the entry of the 

20 database. After one of step S1206 (wait mode 

manipulation process), step S1205 (immediate mode 
manipulation process), and step S1204 (delay mode 
manipulation process) is executed depending on the 
update mode, the process ends. The manipulation 

25 processes for respective update modes will be described 
in detail below with reference to Figs. 13 to 15. 
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Fig. 13 shows the flow of the wait mode 
manipulation process. In step S1301, event data (see 
Fig. 8) is generated based on the contents of the 
manipulation input in step S1201. The flow then 
5 advances to step S1302 to send the generated event data 
to the server. 

The flow of the immediate mode manipulation 
process is as shown in Fig. 14. In step S1401, the 
manipulation command input in step S1201 is executed. 

10 More specif ically, the setting value of the designated 
entry of the database is changed. Next, an event is 
generated (step S1402), and is sent to the server 
(S1403) as in the wait mode. Finally, in step S1404 a 
manipulation queue item in which the manipulation ID 

15 number determined in step S1201 is set in the 

manipulation ID field and the already executed flag is 
set to ON is added to the manipulation queue. At this 
time, since the time-out time is not used in the 
process, it can be arbitrarily set (e.g., 0). 

20 The delay mode manipulation process will be 

described below using Fig. 15. An event is generated 
(step S1501) and is sent to the server (step S1502) as 
in the wait mode. A manipulation queue item in which 
the manipulation ID number determined in step S1201 is 

25 set in the manipulation ID field, the sum of the 

current time and a predetermined time-out time is set 
in the time-out time field, and the already executed 
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flag is set to OFF is added to the manipulation queue 
(step S1503). Finally, a timer process is launched by 
passing the manipulation ID, manipulation contents, and 
time-out time data to it (step S1504). The timer 
5 process will be described in detail later. 

The received event process in step S1106 
(Fig. 11) will be described in detail below. Fig. 16 
shows the flow of the received event process. The 
received event is received from the server by an event 

10 communication module (not shown) and is input to a 
received event buffer. 

In step S1601, the received event buffer is 
searched. It is checked in step S1602 if an event is 
input to the received event buffer. If an event is 

15 found, the flow advances to step S1603. On the other 
hand, if it is determined that no received event is 
present, the process ends. If a received event is 
found, that event data is interpreted to extract the 
contents of a manipulation command (step S1603). In 

20 steps S1604 and S1605, the update mode of the 

manipulation command is determined with reference to 
the update mode ID field of the event. After one of 
step S1608 (in case of the wait mode), step S1606 (in 
case of the immediate mode), and step S1607 (in case of 

25 the delay mode) is executed in accordance with the 
determined update mode, the process ends. In step 
S1608, a manipulation described in the event is 
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executed. More specifically,, the setting value of an 
entry with the designated ID is changed according to 
the manipulation contents. The immediate mode event 
process in step S1606 and delay mode event process in 
5 step S1607 will be described in detail below with 
reference to Figs. 17 and 18 , respectively. 

Fig. 17 shows the flow of the immediate mode 
event process. The manipulation queue is searched in 
step S1701, and it is checked in step S1702 if a 

10 manipulation queue item corresponding to the received 
event is present in the manipulation queue. More 
specif ically, if the client ID of the received event 
matches the ID of the client on which this process is 
running, and the manipulation ID of the received event 

15 matches that of a manipulation queue item, it is 
determined that the manipulation command of that 
manipulation queue item corresponds to that of the 
received event. In the immediate mode, if the 
corresponding queue item is found, its manipulation has 

20 already been executed at the time when it was generated 
at the client of interest. Therefore, the manipulation 
queue entry is deleted in step S1703 without executing 
any manipulation, thus ending the process. On the 
other hand, if it is determined in step SI 702 that no 

25 corresponding queue item is found, that manipulation 
has not been executed yet since it was generated at a 
client other than the client of interest. Therefore, 
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the manipulation is executed in step S1704, and the 
process ends. 

The flow of the delay mode event process is as 
shown in Fig. 18. The manipulation queue is searched 
5 in step S1801, and it is checked in step S1802 if a 
manipulation queue item corresponding to the received 
event is present in the manipulation queue. The 
process details in step S1802 are the same as in step 
S1702. If the corresponding manipulation queue item is 

10 present, the already executed flag of that manipulation 
queue item is checked in step S1803. If the already 
executed flag is ON, since the time-out time has been 
reached, the timer process has already executed the 
manipulation. Therefore, the manipulation queue entry 

15 is deleted in step S1805 without executing any 

manipulation, thus ending the process. On the other 
hand, if it is determined in step S1803 that the 
already executed flag is OFF, since the time-out time 
has not been reached yet, the manipulation is not 

20 executed. Hence, the manipulation is executed in step 
S1806, and that item is deleted from the manipulation 
queue (step S1805). Then, the process ends. If it is 
determined in step S1802 that no corresponding 
manipulation queue item is found, that manipulation has 

25 not been executed yet since it was generated at a 

client other than the client of interest. Therefore, 
the manipulation is executed in step S1804, and the 
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process ends. Note that steps S1804 and S1806 are 
processes with the same contents. 

The timer process launched in step S1504 in 
Fig. 15 will be described in detail below. This 
5 process is executed to cope with a case wherein the 
time-out time has been reached in the delay mode. 

The manipulation queue is searched in step S1901, 
and it is checked in step S1902 if a manipulation queue 
item corresponding to the manipulation, which is 

10 designated upon launching the timer process, is present. 
More specifically, if the manipulation ID as an 
argument upon launching this process matches that of 
the manipulation queue item, it is determined that the 
manipulation command of that manipulation queue item 

15 corresponds to that which is designated by the argument. 
If the corresponding queue item is found, this means 
that the received event corresponding to that 
manipulation command is not processed, i.e., is not 
executed. In this case, the flow advances to a process 

20 for confirming if the time-out time is reached. That 
is, the current time is referred to in step S1903, and 
is compared with the time-out time (step S1904) . If 
the time-out time has been reached, the manipulation is 
executed in step S1905, and the already executed flag 

25 of the corresponding manipulation queue item is set to 
ON (step S1906). On the other hand, if the time-out 
time has not been reached yet, the flow returns to step 
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S1901. If it is determined in step S1902 that no 
corresponding manipulation queue item is found, this 
means that the received event corresponding to that 
manipulation command has already been processed, i.e., 
5 the manipulation has already been executed. In this 
case, since neither execution of the manipulation nor 
the change process of the manipulation queue axe 
required, the process directly ends. 

The flow of the client-side process has been 

10 explained. The flow of the server- side process will be 
described in detail below using Fig. 20. 

In step S2001, the server accepts connection 
requests from clients to establish a communication. At 
this time, the server notifies the clients, with which 

15 the communication has been established, of client IDs. 
The server then searches the received event buffer 
(step S2002) to check if a received event is present 
(step S2003). If a received event is found, the flow 
advances to step S2004; otherwise, the flow jumps to 

20 step S2005. In step S2004, the server transmits the 

event to the connected clients. It is checked in step 
S2005 if the server process is to end in response to a 
user's command (for example, an end button is assigned 
to an arbitrary key of the keyboard, and when that key 

25 is pressed, a user's end command is issued). If the 
server process is to end, the flow advances to step 
S2006; otherwise, the flow returns to step S2002. In 
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step S2006, the server notifies the connected clients 
that the process is to end, and disconnects connection 
to the clients (step S2007), thus ending the process. 
The configuration of the database description 
5 file to be loaded by the client in this embodiment will 
be described below. 



entries. The properties of each entry are described in 
fields bounded by start and end delimiters. In Fig. 24, 

10 the start delimiters of the first, second, and N-th 
entries are respectively denoted by 2401, 2406, and 
2409. On the other hand, the end delimiters of these 
entries are 2405, 2408, and 2411. Each property of an 
entry is described as a pair of an identifier used to 

15 identify that property, and an attribute value, as 
indicated by 2402 to 2404. The update mode and 
time-out time are specified to each entry in the file 
with the above format. If the update mode of the entry 
of interest is other than the delay mode, the time-out 

20 time need not be described. In any update mode, these 
two properties (update mode and time-out time) need not 
always be described. If these properties are not 
described, they are set to be default values determined 
in advance by the system upon building the scene graph 

25 database on the memory (302 in Fig. 3) (step S1101). 

Note that the aforementioned database description 
file describes the update mode to be selected. By 



Fig. 24 shows the file format of data with N 
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contrast, one or a plurality of update modes that 
cannot be selected may be set. Use of such update 
modes that cannot be selected will be described in 
detail later in the update mode change operation 
5 according to the fifth embodiment. 

In the above description, a data communication 
between the server and client is attained by a 
one-to-one TCP/IP socket. Alternatively, events may be 
exchanged by broadcast or multicast , and the 

10 communication protocol is not limited to TCP/IP. 

The Ethernet is used as the communication medium. 
Alternatively, other information transmission media 
such as USB, Firewire, and the like may be used. 
Furthermore, the network is not limited to the LAN, and 

15 connections via a WAN may be adopted or both the LAN 
and WAN may be used in combination. 

The number of servers is not limited to one per 
shared database system, and a plurality of servers may 
be connected. In this case, processes may be 

20 arbitrarily assigned to respective servers. For 

example, different servers may be used for respective 
clients, and servers may be prepared in correspondence 
with respective database entries . 

Furthermore, the number of processes to be 

25 assigned to each terminal is not limited to one process 
per terminal, but a plurality of processes can run on 
one terminal. In this case, arbitrary types of 
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processes may be combined, and the system operates in 
all combinations of only client processes, only server 
processes, and client and server processes. Note that 
processes which run on a single terminal may exchange 
5 data via a shared memory in place of the network. 

Events are distributed to respective terminals 
via the server. Alternatively, a terminal on which the 
data manipulation has been made may directly transmit 
an event to other terminals . When an event is 

10 transmitted without the intervention of the server, the 
manipulator client receives an event from itself in, 
e.g., T406 in Fig. 4. Such procedure can be 
implemented by setting the destination of the event to 
a self host. Note that principal OSs have a function 

15 of making communications without distinguishing self 
and other hosts as a standard function. 

In the above description, 3D virtual space data 
are shared. However, the contents of the database are 
not limited to such specific data, and arbitrary 

20 contents may be shared. Also, the method explained in 
the above embodiment can be applied to not only a case 
wherein the entire database is to be shared but also a 
case wherein the database is to be partially shared. 
These features also apply to other embodiments. 

25 As described above, the first embodiment 

discloses an information processing method for 
maintaining consistency among shared data held by 
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respective processes ±n a system in which each of a 
plurality of processes (client processes) connected via 
an Information transmission medium holds and uses 
sheared data (database) to be shared by these processes. 
5 Especially , upon generation of a manipulation request 
for the shared data, request information (event) that 
represents the manipulation request is output onto the 
information transmission medium, response information 
(event) to this request information is received from 

10 the information transmission medium, and a manipulation 
for the shared data is executed in accordance with the 
received response information. According to such wait 
mode, since the manipulation for the shared data is 
executed in accordance with the event received via the 

15 information transmission medium, the update timings of 
the shared data can be matched with high precision. 

In the delay mode, when a predetermined period of 
time has elapsed in the timer process after generation 
of the manipulation request before reception of 

20 response information, the manipulation for the shared 
data based on the manipulation request is executed 
without waiting for reception of the response 
information. For this reason, both the high response 
speed in a process as a generation source of the 

25 manipulation and matching of the sync timings among a 
plurality of processes can be achieved. 



WO 2004/051480 ^PfcT/JP2003/015274 

- 32 - 



Also, according to this embodiment , a queue item 
is registered in the manipulation queue in accordance 
with a manipulation request. When the manipulation 
execution process executes the manipulation for the 
5 shared data, queue control for setting the 

corresponding queue item to be an already processed 
item is executed. When an item in the manipulation 
queue, which corresponds to a manipulation request 
represented by the response information, is not set to 

10 be an already processed item, the manipulation 

corresponding to the response information is executed 
for the shared data. For this reason, a given 
manipulation can be prevented from being repetitively 
executed in the aforementioned delay mode by a simple 

15 arrangement. 

According to the above embodiment, the system can 
operate in one of a plurality of update modes, which 
include a first mode (wait mode) for executing a 
manipulation of shared data after waiting for reception 

20 of response information in a reception process, and a 
second mode (delay mode) for executing a manipulation 
of shared data at an earlier one of an elapse timing of 
a predetermined period of time after generation of a 
manipulation request and a reception timing of response 

25 information . 

Furthermore, the shared data is made up of a 
plurality of items (Fig. 24), each of which contains 



ft, 
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designation information used to designate a update mode 
to be adopted. The update mode is selected in 
accordance with this designation information, and a 
manipulation for the shared data is executed. That is, 
5 the update mode is switched for each of the plurality 
of items, and this configuration allows to select an 
appropriate update mode for each item. 

In a system in which each of a plurality of 
processes connected via an information transmission 

10 medium holds and uses shared data to be shared by these 
processes, a server process establishes connection to a 
plurality of client processes, and receives an event 
associated with a change in shared data from each of 
these client processes, so as to maintain consistency 

15 of shared data held by the respective processes. The 
server process then issues the received event to the 
plurality of client processes. 
[Second Embodiment] 

In the first embodiment, the server distributes 

20 all events to all clients in all the update modes. 

However, in case of the immediate mode, the manipulator 
client has already executed a manipulation, and need 
not receive any event from the server. In this 
embodiment, the need for event distribution from the 

25 server is obviated in such case. 



1 
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Fig, 21 shows the flow of an event distribution 
process in this embodiment. This process is to be 
executed in place of step S2004 in Fig. 20. 

It is checked in step S2101 if the update mode is 
5 the immediate mode. If the update mode is the 

immediate mode, the server refers to the client ID 
field of an event, and transmits the event to clients 
other than that indicated by the ID (step S2102). On 
the other hand, if the update mode is the wait mode or 

10 delay mode, the server transmits the event to all the 
clients as in the first embodiment (step S2103). Since 
the client process as an event source does not receive 
any event distributed from the server process, the 
reference process and update process of the 

15 manipulation queue can be omitted. 

As described above, according to the second 
embodiment, an event received by the server process 
contains update mode information indicating a change 
sequence of shared data, and the server controls 

20 distribution destinations of the event on the basis of 
this update mode information. For example, the server 
determines based on the update mode information of the 
received event whether or not the event source has 
already processed the shared data. If the server 

25 determines that the shared data has already been 

processed, it controls not to issue that event to the 
client as its source. As shown in Fig. 21, when the 
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update mode is the Immediate mode, since the 
manipulation execution in the source client process is 
complete at the time of reception of the event, the 
event is not distributed to the source client process. 
5 With this process, since the total traffic of 

events to be transmitted from the server to the clients 
can be reduced, the network load can be reduced. Also, 
since the client process as the event source need not 
process the manipulation queue, the processing load on 

10 that process can be reduced. 
[Third Embodiment] 

In the first and second embodiments, when the 
update mode is the delay mode, an event received by the 
server is transmitted to the clients irrespective of 

15 the time-out time. However, when the time-out time has 
elapsed, the manipulator client executes a manipulation 
without receiving any returned event, and need not 
receive any event from the server. The third 
embodiment obviates the need for event distribution in 

20 such case. 

In case of the third embodiment, an event with 
the contents shown in Fig. 22 is used in place of the 
event contents shown in Fig. 8. In Fig. 22, the 
time-out time is added to the event shown in Fig. 8. 

25 This time-out time is calculated by adding the time-out 
interval to the generation time of a manipulation 
command, and is equal to a time which is used as the 
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criterion of judgment by the timer process upon 
starting the manipulation execution in the manipulator 
client . 

Pig, 23 shows the flow of an event distribution 
5 process in the third embodiment. This process is to be 
executed in place of step S2004 in Fig. 20. 

It is checked in step S2301 if the update mode is 
the delay mode. If the update mode is the delay mode, 
the server refers to the current time (step S2302), and 
10 compares the current time and the time-out time 

described in an event (step S2304). If the current 
time is behind the time-out time, the server determines 
that the sender client has already started execution of 
a manipulation. Therefore, the server refers to the 
15 client ID field of the event, and transmits the event 
to clients other than that indicated by the ID (step 
S2305) . On the other hand, if the update mode is other 
than the delay mode or if the time-out time is not 
reached, the flow advances to step S2306, and the 
20 server transmits the event to all the clients. 

With this process, since the total number of 
events to be transmitted from the server to the clients 
can be reduced, the network load can be reduced. 

Note that the current time of the client must 
25 match that of the server so as to accurately determine 
the relationship between the time-out time of the event 
and the current time of the server by comparing them. 
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As a mechanism for this purpose, for example, NTP 
(Network Time Protocol) or the like can be used. 

As described above, the third embodiment provides 
a scheme that allows to determine if the client process 
5 as an event source has completed the manipulation 

execution when the update mode is the delay mode. That 
is, the event contains the time-out time, and when the 
update mode information indicates a update mode (delay 
mode) in which a manipulation is executed if the 
10 time-out time has elapsed, and the current time has 

passed the time-out time, it is determined that event 
source has already processed shared data. 

As described above, according to the second and 
third embodiments, since some pieces of database update 
15 information to be exchanged among terminals can be 
omitted, the load on the network can be reduced. 
[Fourth Embodiment] 

The event distribution processes in the immediate 
mode (second embodiment) and delay mode (third 
20 embodiment) have been explained. However, these 
processes may be combined. 

That is, the fourth embodiment combines the 
network load reduction methods in the second and third 
embodiments . 
25 [Fifth Embodiment] 

In each of the above embodiments, the update 
modes are set in the database description file, and no 
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change in update mode while the system is in service is 
considered. The fifth embodiment will explain a 
database update method having means for changing the 
update mode of a database. 



client in this embodiment. As in the first embodiment, 
the contents of the database are a 3D virtual space , 
and CG images of 3D virtual objects 2503 and 2504 are 
displayed on a 3D space display area 2502 in a display 

10 window 2501. Below the 3D space display area, a 

position setting area 2506, orientation setting area 
2507 , and update mode setting area 2508 , which are 
respectively used to set the position, orientation, and 
update mode of a virtual object, are provided. On the 

15 update mode setting area 2508, radio buttons 

corresponding to the respective update modes are 
displayed. 

Upon setting an update mode, the user moves a 
cursor 2505 onto a virtual object image whose mode is 

20 to be changed, and then clicks the left button of the 

mouse 308 (Fig. 3) to select that object. At this time, 
the radio button corresponding to the update mode, 
which is set for that object, is selected and displayed. 
Next, the user clicks the left button of the mouse to 

25 activate one corresponding to a desired mode of the 

radio buttons displayed on the update mode setting area. 
In this way, the mode of user's choice can be set by 



5 



Fig. 25 shows a window display example of a 
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his or her Interactive manipulation. Note that sliders 
are displayed on the position and orientation setting 
areas 2506 and 2507, and the position and orientation 
of the selected virtual object can be interactively 
5 changed by moving these sliders. 

Fig. 26 shows another display example and user 
interface example. In this case, the user wears an HMD 
(Head Mounted Display) on his or her head, and observes 
a 3D display window 2601 of a virtual space, as shown 

10 in Fig. 26. On the window, reference numerals 2602 and 
2603 denote virtual objects; and 2604, a pointer used 
to select/manipulate an object. The user holds a 
stylus device 2701 shown in Fig. 27 with his or her 
hand, and controls the position and orientation of the 

15 pointer 2604 by moving it. Note that the stylus device 
has a shape like a pointing rod, and comprises a 
position/ orientation sensor and a button. For example, 
the stylus device is used for the purpose of measuring 
the position/orientation of the distal end portion of 

20 the rod at the time of depression of the button. 

Upon changing the update mode, the user moves the 
stylus device 2701 so that the pointer 2604 points up a 
virtual object image whose mode is to be changed, and 
presses a select button 2702 on the stylus device 2701 

25 to select that object. At this time, an annotation 

window that shows the properties of the selected object 
appears on the window that the user observes. The 
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annotation window also shows the currently selected 
update mode. Next, the user turns a dial 2703 provided 
* to the end portion of the stylus device. Since the 
update mode displayed on the annotation window changes 
5 every time the user turns the dial, the user stops 

turning the dial 2703 when a desired mode is displayed. 
In this way, the mode of user's choice can be set by 
his or her interactive manipulation. Note that the HMD 
corresponds to the display module 309 (Fig. 3). The 
10 stylus device 2701 is connected to the input /output 

module 310 via a data transmission cable 2704, and the 
CPU 301 reads out the selection state of the select 
button 2702 and the turning state of the dial 2703. 



15 shown in Figs. 25 and 26, a two-dimensional (2D) 

display may be used. Fig. 28 shows an example of such 
2D display. In this example, a 2D display area 2802 on 
a display window 2801 displays a 2D observation state 
of a 3D space from a given direction. Virtual objects 

20 2803 and 2804 are displayed as icons on the 2D display 
area. When the user sets a cursor 2805 on a desired 
icon and clicks the left button of the mouse 308, he or 
she can select that object. Upon setting the update 
mode, after the user selects the object, he or she 

25 presses a specific key of the keyboard 307, which is 
set by the system in correspondence with the desired 
update mode. In this way, the mode of user's choice 



In place of the 3D display of the virtual space 
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can be set by his or her interactive manipulation. 
Note that an annotation window 2806 that shows the 
properties of the selected object may be displayed on 
the window upon selecting the object. When the 
5 annotation display also shows the currently selected 
update mode, the user can set the update mode while 
confirming the current update mode. 

The three examples of the update mode setting 
method have been explained. However, the 
10 aforementioned update mode setting methods may be 
modified so that if an update mode which cannot be 
selected is designated, the user cannot actually change 
the current mode even when he or she wants to select 
that mode. 

15 Since the update mode is a property of an entry 

in the shared database, when a given client has changed 
the update mode, that change is reflected on other 
clients . That is , the change in update mode is also 
handled as one of manipulation commands, and is 

20 reflected on respective terminals using an event. 

On the other hand, the update mode may be set for 
each client without sharing its setup. Fig. 29 shows 
the flow of the manipulation process in this case. 
This process is executed in place of that shown in 

25 Fig. 12. 

In the process shown in Fig. 29, after a 
manipulation command is input in step S2901, it is 
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checked in step S2902 if the input manipulation command 
is a mode setup. If it is determined that the input 
manipulation command is a mode setup, the flow advances 
to step S2903, and the property value of the update 
5 mode associated with the designated entry is set in 
accordance with the manipulation command. Other steps 
S2904, S2905, S2906, S2907, and S2908 are the same as 
steps S1202, S1203, S1204, S1205, and S1206 in Fig. 12. 
As described above, according to the fifth 

10 embodiment, the user interface which allows the user to 
select an object display corresponding to a desired 
item (entry in Pig. 24) in the shared data and to 
designate a desired update mode is provided (Fig. 25 
and the like). With this user interface, the user can 

15 desirably set the update mode for each item. 

Also, the mode switching result of the update 
mode setting manipulation may be reflected on shared 
data of a plurality of clients or on only the shared 
data of the client of interest. Furthermore, whether 

20 or not the update mode setup (switching result) is 
shared may be allowed to be set. 
[Sixth Embodiment] 

In the fifth embodiment, the means for changing 
the update mode has been explained. Also, means for 

25 changing a time-out time in the delay mode may be added. 
The sixth embodiment will explain an embodiment that 
allows to change the time-out time. 
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For example, such means can be Implemented by- 
adding a slider used to adjust the time-out time on the 
display window of Fig. 25 or adding a dial used to set 
the time-out time to the stylus device in Fig. 27. 
5 Alternatively, the time-out time may be incremented or 
decremented by pressing a predetermined key of the 
keyboard 307. 

Needless to say, the system may comprise one or 
both of the update mode change means explained in the 

10 fifth embodiment and the time-out time change means 
explained in the sixth embodiment. 
[Seventh Embodiment] 

In the above embodiments, the update mode and 
time-out time are set for each entry of the database. 

15 Alternatively, the update mode and time-out time may be 
allowed to be set for each client. Also, the update 
mode and time-out time may be allowed to be set for 
each property of an entry of the database. 
[Eighth Embodiment] 

20 In some database systems, a process for updating 

data and a process for referring to data are executed 
in a given order. In such case, even when a time delay 
is produced from a given manipulation command to its 
execution, if the execution is completed in any data 

25 update process, the manipulation result is reflected on 
reference immediately after that update process. 
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In general, a virtual space drawing system Is one 
of the aforementioned systems, and an update process of 
a scene graph and scene drawing process are alternately 
executed. Fig. 30 is a schematic diagram showing such 
5 system. In Fig. 30, "Update" represents the update 

process, and "Draw" represents the drawing process. A 
pair of update and drawing processes is called a frame. 
In Fig. 30, t x is the manipulation command generation 
time, t 2 is the time-out time, and t 3 is the time at 

10 which the manipulation result is reflected. 

Assume that the request specification associated 
with a delay until the result of a manipulation command 
is reflected on the database is less than two frames . 
Also, assume that one manipulation command is generated 

15 at time ti of the S-th frame. If this manipulation is 
executed before time t 3 , the request specification is 
satisfied. To attain this, the manipulation command 
can be processed in the delay mode by setting, e.g., 
time-out time t 2 . However, it is normally difficult to 

20 estimate time t 2 . 

Hence, the eighth embodiment will explain an 
embodiment that can automatically determine the 
execution timing of a manipulation command. 

In the aforementioned timer process (Fig. 19), a 

25 procedure for detecting the beginning of the database 
update process is added in place of steps S1903 and 
S1904 of confirming the time-out time. If the 
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beginning of the update process is detected in that 
process, the flow advances to step S1905; otherwise, 
the flow returns to step S1901. Note that the timer 
process may be interrupted when the update process in 
5 Fig. 30 has started in place of detecting the beginning 
of the update process, and the flow may advance to step 
S1905- 

As described above, according to the eighth 
embodiment, when the start time of the update process, 

10 which is determined by the system, is reached before 

reception of response information, the manipulation of 
the shared data based on the manipulation request is 
executed without waiting for reception of the response 
information. That is, the time-out timing is 

15 automatically set, and the manipulation command can be 
executed with a desired delay time. 
[Ninth Embodiment] 

In the fifth embodiment, all the update modes are 
manually set. By contrast, the ninth embodiment will 

20 explain an embodiment that automatically sets the 

update mode. In this embodiment, if a manipulation 
command is generated based a user's interactive 
manipulation, the immediate or delay mode is 
automatically set. 

25 In order to realize such process, when an 

interactive manipulation is made, a process for adding 
a command that sets the update mode in the immediate or 
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delay mode can be added before a process for generating 
a manipulation command. At this time, which of the 
immediate and delay modes is to be set is determined in 
advance for each type of interactive manipulations. 
5 For example , when the user moves or rotates a virtual 
object using the sliders in Fig. 25 or the stylus in 
Fig. 27 , the immediate mode is set. On the other hand, 
when the user selects an object by clicking the mouse 
button or pressing the select button (2702 in Fig. 27), 

10 the delay mode is set. 

As described above, according to the ninth 
embodiment, a update mode is set in accordance with the 
manipulation contents for an object corresponding to an 
item of shared data. For example, since the update 

15 mode is automatically set in the immediate or delay 
mode, a time delay from an interactive manipulation 
command until manipulation execution can be shortened 
compared to the wait mode, thus reducing unpleasantness 
due to the delay. 

20 Note that the objects of the present invention 

are also achieved by supplying a storage medium, which 
records a program code of a software program that can 
implement the functions of the above-mentioned 
embodiments to the system or apparatus, and reading out 

25 and executing the program code stored in the storage 

medium by a computer (or a CPU or MPU) of the system or 
apparatus . 
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In this case, the program code itself read out 
from the storage medium implements the functions of the 
above-mentioned embodiments, and the storage medium 
which stores the program code constitutes the present 
5 invention . 

As the storage medium for supplying the program 
code, for example, a flexible disk, hard disk, optical 
disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, 
nonvolatile memory card, ROM, and the like may be used. 

10 The functions of the above-mentioned embodiments 

may be implemented not only by executing the readout 
program code by the computer but also by some or all of 
actual processing operations executed by an OS 
(operating system) running on the computer on the basis 

15 of an instruction of the program code. 

Furthermore, the functions of the above-mentioned 
embodiments may be implemented by some or all of actual 
processing operations executed by a CPU or the like 
arranged in a function extension board or a function 

20 extension unit, which is inserted in or connected to 

the computer, after the program code read out from the 
storage medium is written in a memory of the extension 
board or unit. 
[Effect of Invention] 

25 As described above, according to the present 

invention, the manipulation execution timings for 
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shared data to be shared by a plurality of processes 
can be accurately matched* 

As many apparently widely different embodiments 
of the present invention can be made without departing 
5 from the spirit and scope thereof, it is to be 

understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
claims . 
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CLAIMS 

1. An information processing method for 
maintaining , in a system in which each of a plurality 
of processes connected via an information transmission 

5 medium holds and uses shared data to be shared by the 
processes, consistency of shared data held by the 
respective processes, comprising: 

an output step of outputting, when a manipulation 
request for the shared data is generated, request 
10 information that represents the manipulation request 
onto the information transmission medium; 

a reception step of receiving the request 
information output in the output step and response 
information corresponding to request information output 
15 by other processes from the information transmission 
medium; and 

a manipulation execution step of executing a 
manipulation for the shared data in accordance with 
manipulation request indicated by the response 
20 information received in the reception step. 

2. The method according to claim 1, wherein the 
manipulation execution step includes a step of 
executing the manipulation request generated in the 
self process only after the corresponding response 

25 information is received in the reception step. 

3. The method according to claim 1, wherein the 
manipulation execution step includes a step of 
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executing, when a predetermined period of time elapses 
after generation of the manipulation request before 
reception of the corresponding response information in 
the reception step, the manipulation request generated 
5 in the self process without waiting for reception of 
that response information. 

4. The method according to claim 3, further 
comprising a queue control step of registering a queue 
item in a manipulation queue in response to generation 

10 of the manipulation request, and setting a 

corresponding queue item to be an already processed 
item when the manipulation request is executed, and 

wherein the manipulation execution step includes 
a step of executing, when an item in the manipulation 

15 queue corresponding to the manipulation request 

indicated by the response information is not set to be 
an already processed item, the manipulation request 
indicated by the response information. 

5. The method according to claim 1, wherein the 
20 manipulation execution step operates in one of a 

plurality of update modes which include: 

a first mode of executing a manipulation request 
generated in the self process only after corresponding 
response information is received in the reception step; 
25 and 

a second mode of executing a manipulation request 
generated in the self process at an earlier one of an 
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elapse timing of a predetermined period of time after 
generation of the manipulation request, and a reception 
timing of corresponding response information in the 
reception step. 
5 6. The method according to claim 5, wherein the 

shared data consists of a plurality of items, each of 
which contains designation information used to 
designate a update mode to be adopted. 

7. The method according to claim 6, further 
10 comprising a switching step of switching the update 

mode for each of the plurality of items. 

8. The method according to claim 7, wherein the 
switching step includes a step of providing a user 
interface that allows a user to select an object 

15 display corresponding to a desired item and to 
designate a desired update mode. 

9. The method according to claim 7, wherein a 
update mode switching result in the switching step is 
reflected on the shared data of the plurality of 

20 clients. 

10. The method according to claim 7, wherein a 
update mode switching result in the switching step is 
reflected on the shared data of a client of interest. 

11. The method according to claim 5, further 

25 comprising a setting step of setting the predetermined 
period of time. 
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12. The method according to claim 1, wherein 
execution of the manipulation request in the 
manipulation execution step executes an update process 
for updating the shared data and a drawing process for 

5 updating drawing on the basis of the updated shared 
data in turn, and 

the manipulation execution step includes a step 
of executing , when the update process is ready to be 
executed before reception of corresponding response 
10 information, the manipulation request generated in the 
self process without waiting for reception of that 
response information. 

13. The method according to claim 7, wherein the 
switching step includes a step of setting the update 

15 mode in accordance with manipulation contents for an 
object corresponding to an item. 

14. An information processing method for 
maintaining, in a system in which each of a plurality 
of processes connected via an information transmission 

20 medium holds and uses shared data to be shared by the 

processes, consistency of shared data held by the 

respective processes, comprising: 

an establishment step of establishing connection 

to a plurality of client processes; 
25 a reception step of receiving an event associated 

with a change in shared data from each of the plurality 

of client processes; and 
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an Issuance step of issuing the event received in 
the reception step to the plurality of client processes. 

15. The method according to claim 14 , wherein the 
event received in the reception step contains update 
5 mode information indicating a change sequence of the 
shared data, and 

the issuance step includes a step of controlling 
distribution destinations of the event on the basis of 
the update mode information. 

10 16. The method according to claim 15, wherein the 

issuance step includes a step of checking based on the 
update mode information in the event received in the 
reception step if an issuance source of the event has 
already processed the shared data, and not issuing that 

15 event to the client as the issuance source when it is 
determined that the issuance source has already 
processed the shared data. 

17. The method according to claim 16 , wherein the 
event further contains a time-out time, and 

20 it is determined that the issuance source of the 

event has already processed the shared data when the 
update mode information Indicates a update mode that 
executes a manipulation when the time-out time elapses, 
and when a current time has passed the time-out time. 

25 18. An information processing apparatus for 

maintaining, in a system in which each of a plurality 
of processes connected via an information transmission 
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medium holds and uses shared data to be shared by the 
processes, consistency of shared data held by the 
respective processes, comprising: 

an output unit configured to, when a manipulation 
5 request for the sheared data is generated, output 

request information that represents the manipulation 
request onto the information transmission medium; 

a reception unit configured to receive the 
request information output by said output unit and 
10 response information corresponding to request 
information output by other processes from the 
information transmission medium; and 

a manipulation execution unit configured to 
execute a manipulation for the shared data in 
15 accordance with manipulation request indicated by the 
response information received in said reception unit. 

19. The apparatus according to claim 18, wherein 
said manipulation execution unit executes the 
manipulation request generated in the self process only 

20 after the corresponding response information is 
received by said reception unit. 

20. The apparatus according to claim 18, wherein 
when a predetermined period of time elapses after 
generation of the manipulation request before reception 

25 of the corresponding response information by said 
reception unit, said manipulation execution unit 
executes the manipulation request generated in the self 
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process without waiting for reception of that response 
information. 

21. The apparatus according to claim 20 , further 

comprising a queue control unit configured to register 

5 a queue item in a manipulation queue in response to 

generation of the manipulation request, and setting a 

corresponding queue item to be an already processed 

item when the manipulation request is executed, and 

wherein when an item in the manipulation queue 

10 corresponding to the manipulation request indicated by 

the response information is not set to be an already 

processed item, said manipulation execution unit 

executes the manipulation request indicated by the 

I 

response information . 
15 22. The apparatus according to claim 18, wherein 

said manipulation execution unit operates in one of a 

plurality of update modes which include: 

a first mode of executing a manipulation request 

generated in the self process only after corresponding 
20 response information is received by said reception 

unit ; and 

a second mode of executing a manipulation request 
generated in the self process at an earlier one of an 
elapse timing of a predetermined period of time after 
25 generation of the manipulation request, and a reception 
timing of corresponding response information by said 
reception unit. 



WO 2004/051480 jfl^ ^Ptx/JP2003/0 15274 

W - 56 - 



23. The apparatus according to claim 22 , wherein 
the shared data consists of a plurality of items, each 
of which contains designation information used to 
designate a update mode to be adopted. 
5 24. The apparatus according to claim 23, further 

comprising a switching unit configured to switch the 
update mode for each of the plurality of items. 

25. The apparatus according to claim 24, wherein 
said switching unit provides a user interface that 

10 allows a user to select an object display corresponding 
to a desired item and to designate a desired update 
mode. 

26. The apparatus according to claim 24, wherein 
a update mode switching result of said switching unit 

15 is reflected on the shared data of the plurality of 
clients . 

27. The apparatus according to claim 24, wherein 
a update mode switching result of said switching unit 

is reflected on the shared data of a client of interest. 
20 28. The apparatus according to claim 22, further 

comprising a setting unit configured to set the 

predetermined period of time. 

29. The apparatus according to claim 18, wherein 

execution of the manipulation request by said 
25 manipulation execution unit executes an update process 

for updating the shared data and a drawing process for 
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updating drawing on the basis of the updated shared 
data in turn, and 

when the update process is ready to be executed 
before reception of corresponding response information, 
5 said manipulation execution unit executes the 

manipulation request generated in the self process 
without waiting for reception of that response 
information . 

30. The apparatus according to claim 24, wherein 
10 said switching unit sets the update mode in accordance 

with manipulation contents for an object corresponding 
to an item. 

31. An information processing apparatus for 
maintaining, in a system in which each of a plurality 

15 of processes connected via an information transmission 
medium holds and uses shared data to be shared by the 
processes, consistency of shared data held by the 
respective processes, comprising: 

an establishment unit configured to establish 
20 connection to a plurality of client processes; 

a reception unit configured to receive an event 
associated with a change in shared data from each of 
the plurality of client processes; and 

an issuance unit configured to issue the event 
25 received by said reception unit to the plurality of 
client processes. 
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32. The apparatus according to claim 31 , wherein 
the event received by said reception unit contains 
update mode information indicating a change sequence of 
the shared data, and 



destinations of the event on the basis of the update 
mode information. 

33. The apparatus according to claim 32, wherein 
said issuance unit checks based on the update mode 

10 information in the event received by said reception 
unit if an issuance source of the event has already 
processed the shared data, and does not issue that 
event to the client as the issuance source when it is 
determined that the issuance source has already 

15 processed the shared data. 

34. The apparatus according to claim 33, wherein 
the event further contains a time-out time, and 

it is determined that the issuance source of the 
event has already processed the shared data when the 
20 update mode information indicates a update mode that 

executes a manipulation when the time-out time elapses, 
and when a current time has passed the time-out time. 

35. A control program for making a computer 
execute an information processing method of any one of 

25 claims 1 to 17. 



5 



said Issuance unit controls distribution 
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36. A storage medium storing a control program 
for making a computer execute an information processing 
method of any one of claims 1 to 17. 



5 
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